METHOD, APPARATUS, AND RECORDING MEDIUM FOR GENERATING ALBUM 



BACKGROUND OF THE INVENTION 
Field of the Invention 
The present invention relates to a method and an apparatus 
for generating an album by arranging a plurality of images 
obtained by a digital camera in a desired layout. The present 
invention also relates to a computer - readable recording medium 
storing a program to cause a computer to execute the album 
generation method. 

Description of the Related Art 
Various methods of generating an album by arranging a 
plurality of images obtained by photographing in a desired layout 
have been proposed. For example, in a method proposed in 
Japanese Unexamined Patent Publication No. 3 ( 1 9 9 1 ) - 27 4 0 4 7 , 
images in frames of a film and photographing direction 
information recorded for each of the frames are read, and the 
images laid out on one sheet are printed by adjusting orientation 
of each of the frames based on the photographing direction 
information. Another method comprising the steps of reading 
photographing information recorded for each of frames at the 
time of photographing and laying out the information together 
with images of the frames to generate an album has also been 
proposed (Japanese Unexamined Patent Publication No. 
3 (1991) -274857) . Furthermore, a method of generating an album 
by arranging images owned by a user in a desired layout and 



by further inserting characters and items of clip art has been 
known (Japanese Unexamined Patent Publication No. 
7 (1995) -184032) . However, in these methods, the layout needs 
to be specified manually by a user, which leads to a complicated 
layout operation. 

Therefore, another method of generating an album easing 
layout operation has been proposed (Japanese Unexamined Patent 
Publication No . 10(1998) -51576) . In thi s me thod , uponprinting 
a plurality of images on one sheet for generating an album, 
a user specifies the images to be printed and a layout thereof 
by using a mark sheet or the like, and information specifying 
the images and the layout is obtained by reading the mark sheet. 
Based on the information, the images are read from a film and 
the album having the images laid out therein is generated. 
According to this method, the user can obtain the album having 
the images by only specifying the images to be printed and where 
the images are arranged in the album. 

However, in the method described in Japanese Unexamined 
Patent Publication No. 10(1998) -51576, the layout needs to be 
specified by a user. Since an impression of an album changes 
depending on how images are laid out therein, a user needs to 
spend time on a layout in order to obtain an album giving a 
preferable impression. If the user does not spend this time 
on the layout, only an album giving an ordinary impression is 
generated . 
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SUMMARY OF THE INVENTION 
The present invention has been conceived based on 
consideration of the above problem. An object of the present 
invention is therefore to provide a method and an apparatus 
for generating an album giving a preferable impression without 
spending much time thereon, and to provide a computer - readable 
recording medium storing a program to cause a computer to execute 
the album generation method. 

An album generation method of the present invention is 
a method of generating an album comprising a composite image 
in which a plurality of images obtained by a digital camera 
are arranged in a desired layout. In this method, the digital 
camera comprises image recording means for recording image data 
sets representing the images in a recording medium with 
accompanying information regarding the image data sets added 
thereto, and the method comprises the steps of: 

reading the image data sets and the accompanying 
information added thereto from the recording medium; and 

generating composite image data representing the 
composite image based on the accompanying information by 
inserting the respective images represented by the image data 
sets in image insertion areas of a template having the image 
insertion areas corresponding to the accompanying information. 

The "accompanying information" refers to information on 
the image data sets and can be added to the image data sets 
by the digital camera. The date of photographing, a location 
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of photographing, the kind of a subject, and a comment on a 
scene can be included as the accompanying information. 

For "recording the image data sets in a recording medium 
with accompanying information added thereto", various methods 
can be used. For example, the accompanying information is 
recorded in a file header of each of the image data sets, or 
together with the image data sets in the same file such as a 
FlashPix file. Alternatively, the accompanying information 
and the image data sets are recorded in separate files by being 
related to each other. In the case where image data sets that 
are not used for an album are recorded in the recording medium, 
the accompanying information includes information indicating 
whether or not each of the image data sets is used for the album. 

The "recording medium" can be a portable recording medium 
such as a memory card, an FD , or an MO disc. Alternatively, 
the recording medium can be a hard disc of a personal computer. 
The accompanying information and the image data sets are read 
from a portable recording medium by using a memory card reader 
or an FD drive, for example. Alternatively, the accompanying 
information and the image data sets are read from a hard disc 
of a personal computer via a network. 

The "template" has the image insertion areas for insertion 
of the images in a desired layout. The image insertion areas 
are related to the accompanying information of the image data 
sets, and the images represented by the image data sets added 
with the accompanying information corresponding to the 



respective image insertion areas are inserted therein. Not 
only the images but also a prepared comment on the images, a 
comment based on the accompanying information, and a clip art 
can be inserted, for example. Furthermore, the template may 
be recorded in the recording medium having the accompanying 
information and the image data sets or in another recording 
medium, and the template is read at the time of album generation . 
Alternatively, information specifying the template may be 
recorded in a recording medium described above so that the 
template can be read from template storing means such as a 
database storing a plurality of templates, with reference to 
the information specifying the template. 

In the album generation method of the present invention, 
the template may be selected based on the accompanying 
information . 

Furthermore , in the album generation method of the present 
invention, the composite image datamay be generatedby inserting 
the accompanying information together with the images in the 
template . 

In the album generation method of the present invention, 
it is preferable for the digital camera to further comprise: 

photographing means for obtaining image data representing 
a subject by photographing the subject; 

storage means for storing recommended composition data 
sets representing images of recommended composition at various 
photographing locations by relating photographing information 



including location information representing the photographing 
locations to the recommended composition data sets; 

photographing information obtaining means for obtaining 
acquired photographing information; 
5 reading means for reading a desired one of the recommended 

composition data sets related to the photographing information 
corresponding to the acquired photographing information from 
the storage means, based on the acquired photographing 
information obtained by the photographing information obtaining 
rf.0 means; and 

; =fi display means for displaying a recommended composition 

a image represented by the desired recommended composition data 

■ r\ set in superposition on an image represented by the image data 

obtained by the photographing means. In this case, the image 
:?X5 recordingmeans includes the acquired photographing information 

in the accompanying information and adds the accompanying 
information to the image data obtained by the photographing 
means based on the recommended composition. In this manner, 
a plurality of sets of the image data having the accompanying 
20 information are recorded in the recording medium. 

The "storage means" may be a portable recording medium 
storing the recommended composition data sets for each 
photographing area or photographing purpose, or a recording 
medium wherein the recommended composition data sets can be 
25 rewritten. 

The "recommended composition" refers to an image 
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representing a notable scene or building to be photographed, 
for example. The recommended composition data sets may 
represent the recommended composition in color. However, in 
order to reduce the amount of data, image data having reduced 
5 contrast, binary image data, or monochrome image data may be 

used as the recommended composition data sets. 

The "acquired photographing information" includes the 
location information representing the locations, information 
representing directions, information indicating the time and 
10 date, and weather information representing weather at the time 

of photographing, for example. Based on the acquired 
■ photographing information, the desired one of the recommended 

i composition data sets can be read. 

In this case, the "accompanying information" includes 
15 not only the location information, the direction information, 

the time and date information, and the weather information, 
but also a photographing condition (such as a focal distance 
and a diaphragm value) and a recommended composition ID 
indicating the recommended composition data set that has been 
20 read. 

As the "display means", various means may be used. For 
example, a f inder of a camera , or a 1 iquid crys tal di splay moni tor 
thereof can be used. 

In some cases, the image obtained by photographing 
25 according to the recommended composition is blurred or not 

preferable due to poor exposure or unfavorable weather, for 



7 



example. In such a case, it is preferable for the image data 
representing the undesired image to be replaced with prepared 
image data corresponding to the recommended composition. 

An album generating apparatus of the present invention 
is an apparatus for generating an album having a composite image 
in which a plurality of images obtained by a digital camera 
are arranged in a desired layout. The digital camera comprises 
image recording means for recording image data sets representing 
the images and having accompanying information regarding the 
image data sets in a recording medium. The album generating 
apparatus comprises: 

reading means for reading the image data sets and the 
accompanying information added thereto from the recording 
medium; and 

composition means for generating composite image data 
representing the composite image based on the accompanying 
information by inserting the respective images represented by 
the image data sets into image insertion areas of a template 
having the image insertion areas corresponding to the 
accompanying information. 

It is preferable for the album generating apparatus of 
the present invention to further comprise template selecting 
means for selecting the template based on the accompanying 
information . 

Furthermore, in the album generating apparatus of the 
present invention, it is preferable for the composition means 

8 



to generate the composite image data by inserting the 
accompanying information in the template in addition to the 
images . 

In the album generating apparatus of the present invention, 
5 it is preferable for the digital camera to further comprise: 

photographing means for obtaining image data representing 
a subject by photographing the subject; 

storage means for storing recommended composition data 
sets representing images of recommended composition at various 
-10 photographing locations by relating photographing information 

including location information representing the photographing 
locations to the recommended composition data sets; 

photographing information obtaining means for obtaining 
acquired photographing information; 
15 reading means for reading a desired one of the recommended 

composition data sets related to the photographing information 
corresponding to the acquired photographing information from 
the storage means, based on the acquired photographing 
information obtained by the photographing information obtaining 
2 0 means; and 

display means for displaying a recommended composition 
image represented by the desired recommended composition data 
set in superposition on an image represented by the image data 
obtained by the photographing means. In this case, the image 
2 5 recording means includes the acquired photographing information 

in the accompanying information and adds the accompanying 
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information to the image data obtained by the photographing 
means based on the recommended composition. In this manner, 
a plurality of sets of the image data having the accompanying 
information are recorded in the recording medium. 
5 In this case, it is preferable for the composition means 

to enable replacement of the image data obtained according to 
the desired recommended composition data set with prepared image 
data corresponding to the desired recommended composition data 
se t . 

Clo The album generation method of the present invention may 

qj be provided as a program recorded in a computer - readabl e 

-| recording medium to cause a computer to execute the method. 

..3 According to the present invention, the image data sets 

are obtained by photographing the images with the digital camera, 
-15 and the accompanying information related to the image data sets 

.ij is recorded in the recording medium by being added to the image 

data sets. The image data set s and the accompanying information 
are read from the recording medium, and the images represented 
by the image data sets are inserted in the respective image 
20 insertion areas of the template with reference to the 

accompanying information. Since the template has the image 
insertion areas set in accordance with the accompanying 
information, the image data sets can be related to the image 
insertion areas of the template according to the accompanying 
25 information. The images are inserted in the respective image 

insertion areas corresponding thereto, and the composite image 
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is generated. In this manner, a user can generate the composite 
image data by simply recording the image data sets having the 
accompanying information added thereto in the recording medium 
at the time of photographing with the digital camera and by 
5 selecting the template. Therefore, the user can obtain the 

album giving a preferable impression by printing the composite 
image data, without spending time on the layout. 

Furthermore, by inserting the accompanying information 
in the template together with the images, information on the 

QLO images inserted in the image insertion areas of the template 

00 can be recognized in the album. 

■i Moreover, the acquired photographing information 

-0 including the location information representing the location 

of aphotographer (theuser) having the digital camera is obtained 
==Sl5 by the photographing information obtaining means, and the 

/:= desired recommended composition data set related to the 

:==. photographing information corresponding to the acquired 

photographing information is read from the storage means based 
on the acquired photographing information. The recommended 
20 composition image represented by the recommended composition 

data set and the image represented by the image data obtained 
by the photographing means are superposed and displayed on the 
display means . The recommended composition data set is related 
to the photographing information including the location 
25 information representing the photographing location. The 

recommended composition data set also represents the image of 
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the recommended composition at the photographing location. 
Therefore, the recommended composition image displayed on the 
display means represents the recommended composition image to 
be photographed at the location of the photographer having the 
5 digital camera. The photographer can therefore confirm the 

image necessary for the album at his/her location by viewing 
the display means , and photographing can be carried out by using 
the recommended composition regardless of the skills of the 
photographer if the photographer only causes the image 

10 represented by the image data obtained by the photographing 

= means to agree with the recommended composition image . In this 

manner, photographing can be carried out without losing a chance 
to photograph the image necessary for the album. Moreover, 
since the acquired photographing information is included in 

15 the accompanying information, the layout of the images in the 

template can be determined based on the photographing 
information, by relating the photographing information to the 
respective image insertion areas of the template. 

In some cases, the image obtained by photographing 

20 according to the recommended composition is blurred or not 

preferable due to poor exposure or unfavorable weather, for 
example. Furthermore, the user may forget photographing. In 
such a case, a preferable image can be included in the album 
by replacing the undesired image with another prepared image 

25 corresponding to the recommended composition or by inserting 

another prepared image in the image insertion area corresponding 
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to the image whose photographing was not carried out. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is a block diagram showing a configuration of 
an image output system adopting an album generating apparatus 
5 as a first embodiment of the present invention; 

Figure 2 is a block diagram showing a configuration of 
a camera used in the first embodiment ; 

Figure 3 shows thumbnail images of templates displayed 
on a personal computer of a user; 
~10 Figure 4 shows an example of a recommended composition 

image ; 

Figure 5 shows an example of an image that is going to 
be photographed; 

Figure 6 shows an example of a superposition image; 
15 Figure 7 is a flow chart showing operation of the camera; 

Figure 8 shows template examples ; 

Figure 9 is a flow chart showing operation of the first 
embodiment ; 

Figure 10 is a block diagram showing a configuration of 
20 an image output system adopting an album generating apparatus 

as a second embodiment of the present invention; 

Figure 11 shows a menu for selecting recommended 
composition; 

Figure 12 is a block diagram showing a configuration of 
25 an image output system adopting an album generating apparatus 

as a third embodiment of the present invention; 
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Figure 13 is a table indicating recommended composition 
IDs to be used for insertion in image insertion areas of 
templates ; 

Figure 14 shows an example of description of accompanying 
information in a template; and 

Figure 15 shows another example of description of the 
accompanying information in a template. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 
Hereinafter, embodiments of the present invention will 
be explained with reference to the accompanying drawings. 

Figure 1 is a block diagram showing a configuration of 
an image output system adopting an album generating apparatus 
asa first embodiment of the present invention . The image output 
system in this embodiment is installed in a laboratory for 
carrying out printing based on users' requests. As shown in 
Figure 1, the image output system in the first embodiment 
comprises album generating means 12 for generating composite 
image data M used for an album based on a plurality of sets 
of image data SO obtained by a camera that will be explained 
later, a printer 13 for printing the composite image data M, 
a monitor 14 such as a CRT display or a liquid crystal display 
for displaying the image data sets SO, the composite image data 
M and the like, and input means 15 comprising a mouse, a keyboard 
and the like for carrying out various kinds of inputs to the 
album generating means 12 . 

The album generating means 12 comprises data reading means 
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21 for reading the image datasetsSO and accompanying information 
H from a recording medium 11 storing the image data sets SO 
and the accompanying information H added to the image data sets 
by the camera, template storing means 22 for storing template 
5 data sets T representing a plurality of templates (hereinafter 

the templates are also called T) , and composition means 23 for 
generating the composite image data M by arranging images 
represented by the image data sets SO (hereinafter the images 
arealsocalledSO) in the templates T represented by the template 
: ; ;3.0 data sets T read from the template storing means 22. 

5j The camera that records the image data sets SO and the 

-j accompanying information H in the recording medium 11 will be 

: lj explained below. Figure 2 is a block diagram showing a 

configuration of the camera used in this embodiment. As shown 
: |3_5 in Figure 2, the camera comprises photographing means 1 for 

•5 obtaining each set of the image data SO representing a subject 

by photographing the subject, a frame memory 2 for temporarily 
storing the image data set SO, GPS means 3 for obtaining GPS 
information G based on global positioning radio waves from GPS 
20 satellites, recommended composition storing means 4 for storing 

recommended composition data sets R0 representing a plurality 
of images having recommended composition at respective 
photographing locations by relating the recommended composition 
data sets R0 with location information representing the 
25 respective photographing locations , reading means 5 for reading , 

from the recommended composition storing means 4, one of the 
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recommended composition data sets RO related to the location 
information agreeing with the GPS information G obtained by 
the GPS means 3, a frame memory 6 for temporarily storing the 
recommended composition data set RO, superposition means 7 for 
obtaining superposition image data CO by superposing the image 
data set SO with the recommended composition data set RO , display 
means 8 for displaying the superposition image data CO, an alarm 
9 for sounding an alarm when the reading means 5 reads the 
recommended composition data set RO, and recording means 10 
for recording the image data set SO obtained by photographing 
in the recording medium 11. 

The photographing means 1 comprises various kinds of means 
necessary for photographing, such as CCDs, an imaging optical 
system, a shutter, a zooming mechanism, an AE mechanism, and 
an AF mechanism. 

The GPS means 3 obtains information on the photographing 
location, a photographing direction, and the time and date of 
photographing as the GPS information G by using the global 
positioning radio waves from the GPS satellites. The 
photographing location is a position at which the camera in 
this embodiment is located, that is, a position where a 
photographer (user) is. The photographing direction refers 
to the direction to which the camera in this embodiment is 
directed . 

The recommended composition storing means 4 is a portable 
recording medium storing the recommended composition data sets 
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RO classified for each photographing area or photographing 
purpose. The recommended composition storing means 4 is 
provided from the laboratory to the user and the user uses the 
recommended composition storing means 4 after setting the means 
5 to the camera. The recommended composition data sets RO 

represent images of recommended composition to be used for 
photographing at sightseeing spots, for example. The 
recommended composition data sets RO are stored in the 
recommended composition storing means 4 in relation to the 

10 location information of the recommended composition. For 

example, if the recommended composition storing means 4 is for 
Kyoto, the recommended composition images represent images of 
the recommended composition for photographing at sightseeing 
spots such as Kinkakuj i temple and Kiyomizudara temple, and 
-15 are related to latitude and longitude of the sightseeing spots. 

The recommended composition storing means 4 stores 
template information indicating a desired one of the templates 
T to be used for generating the album. The desired template 
is selected by the user in advance and the template information 

20 is stored in the recommended composition storing means 4 before 

the recommended composition storing means 4 is provided from 
the laboratory to the user. As the template information, a 
template number can be used, for example. In this case, the 
recommended composition storing means 4 stores the recommended 

25 composition data sets RO representing the composition necessary 

for the album, and the number of the recommended composition 
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data sets RO is in accordance with the number of images to be 
inserted in the template selected by the user. 

The recommended composition storing means 4 may be a 
rewritable recording medium fixed to the camera so that the 
5 recommended composition data sets RO for a photographing area 

or a photographing purpose desired by the photographer can be 
stored in the recommended composition storing means 4 by being 
wri tten therein . For example, the recommended composition data 
sets RO are stored in a database of the laboratory and the user 
10 accesses the database to download the desired recommended 

composition data sets RO . The downloaded data sets RO are 
wri tten in the recommended composition storing means 4 and stored 
therein . 

Thumbnail images of the recommended composition images 
15 in accordance with the desired photographing area or purpose 

may be displayed on a personal computer of the user before 
downloading so that the user can make a selection therefrom 
to download the recommended composition data sets RO . In this 
case, thumbnail images of the templates having the recommended 
2 0 composition images laid out therein are displayed on the personal 

computer of the user after downloading, as shown in Figure 3. 
In this manner, the user selects the desired one of the templates 
T from the thumbnail images and the template information 
indicating the selected template is stored in the recommended 
25 composition storing means 4. 

The templates T may be related to the recommended 
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composition data sets RO , and the thumbnail images shown in 
Figure 3 may be displayed on the personal computer of the user. 
After the selection of the desired thumbnail image of the template, 
the recommended composition data sets RO corresponding to the 
5 selected template are downloaded in this case. Furthermore, 

only the recommended composition data sets RO may be stored 
in the recommended composition storing means 4. In this case, 
the recording means 10 which will be explained later records 
the template information in the recording medium 11 by using 

10 input means of the camera not shown in Figure 2. 

The template information may not be recorded in the 
recording medium 11. In this case, the user notifies the 
laboratory of the template to be used. Upon generating the 
album, the template information is input to the album generating 

15 means 12 from the input means 15 by an operator of the laboratory. 

In this embodiment, the recommended composition data sets 
RO representing the recommended composition corresponding to 
a tour course determined in Europe and the templates using the 
recommended composition are stored in the recommended 

20 composition storing means 4. 

The reading means 5 searches the recommended composition 
storing means 4 for the recommended composition data set RO 
corresponding to the location information included in the GPS 
information G, and the reads the recommended composition data 

25 set RO corresponding to the location information from the 

recommended composition storing means 4. The recommended 
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composition data set RO is temporarily stored in the frame memory 

6 . 

The superposition means 7 obtains the superposition image 
data CO by superposing the image data set SO with the recommended 
5 composition data set RO . For example, in the case where the 

recommended composition image (hereinafter the recommended 
composition image is also called RO) represented by the 
recommended composition data set RO is as shown in Figure 4 
and the image SO represented by the image data set SO is as 
~10 shown in Figure 5, the superposition image (hereinafter the 

superposition image is also called CO) represented by the 
superposition image data CO obtained by the superposition means 

7 is as shown in Figure 6 . The superposition image CO is displayed 
on the display means 8. By setting the contrast of the 

15 recommended composition image represented by the recommended 

composition data set RO lower than the contrast of the image 
represented by the image data set SO , the image SO becomes easier 
to see. The recommended composition image may be a monochrome 
image or a binary image. The recommended composition images 

20 RO may be stored in the recommended composition storing means 

4 as data sets of low-contrast images, monochrome images, binary 
images, or images comprising outlines only, for example. 

The display means 8 is a liquid crystal panel installed 
in the camera in this embodiment. Instead of the liquid crystal 

25 panel, a finder may be installed in the camera as the display 

means so that the images can be displayed therein. 
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The alarm 9 sounds an alarm by detecting a fact that the 
reading means 5 has read the recommended composition data set 
RO, and notifies the photographer of a fact that he/she is at 
the photographing location of the recommended composition. A 
5 voice may be used instead of the alarm. Alternatively, the 

fact that the photographer is at the location may be displayed 
on the display means 8, or vibration may be used to notify the 
photographer of the fact. 

The recording means 10 records the image data set SO 
10 obtained by photographing and the accompanying information H 

thereof in the recording medium 11. The accompanying 
information H includes the GPS information G obtained by the 
Z GPS means 3, a comment on the image displayed on the display 

means 8 made by the user with the input means not shown, and 
r =15 a file number of the image data set SO. The accompanying 

: information H may be recorded in a file header of the image 

data set SO or in the same file as the image data set SO as 
in the case of a FlashPix format file, or in a file separate 
from the file of the image data set SO by being related to the 
20 image data set SO. 

Operation of the camera shown in Figure 2 will be explained 
next. Figure 7 is a flow chart showing the operation of the 
camera shown in Figure 2 . In this embodiment, the photographer 
holds the camera and the photographing means 1 is initially 
25 switched off while the GPS means 3 is on. 

The GPS means 3 obtains the GPS information G based on 
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the global positioning radio waves from the GPS satellites (Step 
SI) . The reading means 5 searches for the recommended 
composition data set RO stored in the recommended composition 
storing means 4 based on the location information included in 
the GPS information G (Step S2) . Whether or not the recommended 
composition data set RO corresponding to the location 
information of the GPS information G is stored in the recommended 
composition storing means 4 is judged (Step S3) . When a result 
at Step S3 is negative, the procedure returns to Step SI, and 
the processing from Step SI to S3 is repeated. When the result 
at Step S3 is affirmative, the recommended composition data 
set RO is read from the recommended composition storing means 
4 (Step S4) , and input to the superposition means 7 after 
temporarily stored in the frame memory 6 . When the recommended 
composition data set RO is read from the recommended composition 
storingmeans 4 , the alarm 9 alarms (StepS5) . In thi s embodiment , 
the recommended composition data set RO representing the 
recommended composition image shown in Figure 4 is read. The 
photographer switches the photographing means 1 on after hearing 
the alarm (Step S6), and the alarm is turned off when the 
photographing means 1 is switched on (Step S7) . 

When the photographing means 1 is set, the image data 
set SO representing the image to be photographed by the 
photographing means 1 is temporarily stored in the frame memory 
2 while input to the superposition means 7 for real time display 
on the display means 8. The superposition means 7 superposes 



the recommended composition image RO with the image SO 
represented by the image data set SO (Step S8) , and displays 
the superposition image CO shown in Figure 6 on the display 
means 8 (Step S9) . 

The photographer adjusts the direction of photographing 
and the zoom function while viewing the superposition image 
CO displayed on the display means 8, and causes the image SO 
to agree with the recommended composition image RO . When the 
shutter is pressed while the image SO is in accordance with 
the recommended composition image RO (Step S10) , photographing 
is carried out and the image data set SO added with the 
accompanying information H is recorded in the recording medium 
11 by the recording means 10 (Step Sll) to end the procedure. 
Superposition and display of the image SO to be photographed 
by the photographing means 1 and the recommended composition 
image RO are repeatedly carriedout until the shutter is pressed. 
If necessary, the image SO is displayed on the display means 
8 and information regarding a comment on the image SO or regarding 
whether the image SO is used for the album may be input by the 
input means, not shown. This information is included in the 
accompanying information H. 

Photographing is carried out for all the recommended 
composition images RO, and the sets of the image data SO 
corresponding to the respective recommended composition images 
are related to the accompanying information H and recorded in 
the recording medium 11. The template information stored in 



the recommended composition storing means 4 is read from the 
recommended composition storing means 4 and recorded in the 
recording medium 11 . In the case where the template information 
is not recorded in the recommended composition storing means 
5 4 , the template information input from the input means not shown 

is recorded in the recording medium 11. The template 
information may be recorded in a recording medium other than 
the recording medium 11. In this embodiment, only the images 
SO corresponding to the recommended composition images RO are 
10 photographed and the image data sets SO whose number agrees 

with the number of the recommended composition data sets RO 
are recorded in the recording medium 11. 

The data reading means 21 of the album generating means 
12 shown in Figure 1 reads the image data sets SO and the 
15 accompanying information H from the recording medium 11, and 

inputs the image data sets SO and the accompanying information 
H to the composition means 23. In the case where the template 
information is also recorded in the recording medium 11, the 
template information is also read therefrom by the data reading 
20 means 21 and input to the composition means 23. In the case 

where the template information is recorded in a recording medium 
separate from the recording medium 11 , the template information 
is read therefrom. In the case where the template information 
is not recorded in either the recording medium 11 or the separate 
25 recording medium, the template information specified by the 

user in advance is input from the input means 15 by the operator . 
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The composition means 23 reads the template data set 
representing the template corresponding to the template 
information. Figure 8 shows examples of the templates T. As 
shown in Figure 8, an album of a trip to Europe is generated 
by using two templates Tl and T2 . The template Tl has four 
image insertion areas A1-A4 , an area A5 for inserting a caption, 
and an area A6 for inserting a clip art . The template T2 includes 
five image insertion areas A7-A11, an area A12 for inserting 
a caption, and an area A13 for inserting a clip art. Areas 
for inserting the accompanying information H are also available 
as shown by hatched lines at the bottom of the image insertion 
areas in Figure 8 . 

The image insertion areas A1-A4 and A7-A11 in the templates 
Tl and T2 are related to the accompanying information H. For 
example, the image data sets SO in the recording medium 11 
correspond to the tour course in the trip to Europe in this 
embodiment, and the order of photographing is also determined 
according to places to visit in the tour. Therefore, if the 
image data sets SO are arranged based on the information on 
the photographing time and date of the accompanying information 
H added to the image data sets SO, the order of the image data 
sets SO corresponds to the order of the places visited in the 
tour. Consequently, if the templates are set for image 
insertion in the image insertion areas A1-A4 and A7-A11 in 
chronological order, the images SO obtained by the user are 
inserted in the templates Tl and T2 without consideration of 



arrangement of the images by the user, if the image data sets 
SO input to the composition means 23 are simply inserted in 
the image insertion areas A1-A4 and A7-A11 in chronological 
order with reference to the accompanying information H. 

The accompanying information H includes the location 
information representing latitude and longitude of the 
photographing location based on the GPS information G. 
Therefore, the image insertion areas A1-A4 and A7-A11 may be 
related to the location information so that the images SO having 
the corresponding location information can be inserted in the 
respective image insertion areas. 

The accompanying information H includes the comment made 
by the user, in addition to the photographing location and the 
time and date of photographing, for example. The accompanying 
information H is inserted in the areas shown by the hatched 
lines at thebottomof the image insertion areas Al ~A4 andA7~All . 
Meanwhile, the captions prepared with regard to the inserted 
images are inserted in the areas A5 and A12 , and the clip arts 
are also inserted in the areas A6 and A13 . The captions and 
the clip arts may be predetermined or selected by the user from 
a plurality of samples, or generated by the user. 

As has been described above, the composite image data 
M are generated by inserting the images, the captions and the 
clip arts in the templates. 

Since the image insertion area A10 in the template T2 
is larger than the other image insertion areas, the most 



impressive one of the images may be inserted therein in some 
cases. In such a case, the image SO desired by the user is 
displayed on the display means 8, and information indicating 
that the image SO is inserted in the image insertion area A10 
5 in the template T2 is input by the camera and included in the 

accompanying information H. In this manner, the composition 
means 23 can insert, in the image insertion area A10 in the 
template T2 , the image SO having this information in the 
accompanying information. In this case, the other images are 
10 inserted in chronological order in the image insertion areas 

excluding the image insertion area A10. 

Operation of this embodiment will be explained next. 
Figure 9 is a flow chart showing the operation of this embodiment . 
The data reading means 21 reads the image data sets SO and the 
15 accompanying information H thereof from the recording medium 

11 (Step S21) . The image data sets SO and the accompanying 
information H are input to the composition means 23. The 
composition means 23 reads the templates from the template 
storing means 22 based on the template information stored in 
20 the recording medium 11 or input from the input means 15 or 

the like (Step S22) . The images SO represented by the image 
data sets SO are inserted in the templates based on the 
accompanying information H (Step S23), and the captions and 
the clip arts are also inserted to generate the composite image 
25 data M (Step S24) . The composite image data M are input to 

the printer 13 and output as the album (Step S25) to end the 
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procedure . 

As has been described above, in this embodiment , the image 
data sets SO of the images corresponding to the recommended 
composition to be inserted in the templates are obtained by 
5 the camera shown in Figure 2, and recorded in the recording 

medium 11 together with the accompanying information H thereof . 
The image data sets SO and the accompanying information H are 
read from the recording medium 11, and the images SO represented 
by the image data sets SO are arranged in the templates based 
10 on the accompanying information H. Since the image insertion 

areas of the templates are related to the accompanying 
information H added to the image data sets SO, the composition 
means 23 generates the composite image data M by inserting, 
in the image insertion areas, the images SO having the 
15 accompanying information H corresponding to the respective 

image insertion areas of the templates. Therefore, the user 
can obtain the album having the photographed images arranged 
therein, by simply selecting the templates and photographing 
the images in accordance with the recommended composition, 
20 without selecting the images and the layout thereof. In this 

manner, the user can spare time upon album generation. 

A second embodiment of the present invention will be 
explained next. Figure 10 is a block diagram showing a 
configuration of an image output system adopting an album 
25 generating apparatus as the second embodiment of the present 

invention. In the second embodiment, the same elements as the 
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elements in the first embodiment have the same reference numerals , 
and detailed explanation thereof is omitted. In the second 
embodiment, storage means 24 is used for storing image data 
sets SK representing images corresponding to recommended 
composition and photographed in a preferable condition. 
Composite image data M generated by composition means 23 are 
temporarily displayed on a monitor 14 and a composite image 
is confirmed thereby. In the case where an undesired image 
is included in the composite image, the image is replaced with 
one of the images photographed in a preferable condition. 

For example, if a tour course includes the Louvre and 
the recommended composition image at the Louvre is Mona Lisa, 
photographing the painting of Mona Lisa is desired. However, 
the painting is in the museum and use of flash is not allowed. 
Therefore, only a dark image of Mona Lisa may be obtained when 
photographing is actually carried out. For this reason, one 
of the image data sets SK representing the painting of Mona 
Lisa obtained by using a bright lens and a high-speed film is 
prepared in the storage means 24. If the photographed image 
of Mona Lisa is not preferable when the composite image is 
confirmed on the monitor 14, the image is replaced with the 
image represented by the image data set SK. 

Meanwhile, in the case where Mout Blanc is included in 
the tour course but the mountain is covered with cloud at the 
time of photographing due to changeable mountain weather, or 
in the case where a desired image of the mountain cannot be 



obtained due to unfavorable weather, one of the image data sets 
SK representing an image of Mout Blanc obtained by photographing 
in a preferable weather at almost the same time of the day and 
year is prepared in the storage means 24, and the undesired 
image of Mont Blanc is replaced with the image represented by 
the image data set SK when the composite image is confirmed 
on the monitor 14. 

By replacing the undesired image in the composite image 
with the image obtained in a preferable condition, the album 
giving a preferable impression can be generated. 

In the above embodiments , the alarm 9 of the camera notifies 
the photographer of the location of the recommended composition . 
However, photographing the image of the recommended composition 
may be forgotten in some cases. Therefore, when the images 
are inserted in the image insertion areas of the templates in 
chronological order upon generating the album, the last image 
insertion area (for example, the insertion area All of the 
template T2 ) is not filled when a photographing chance is missed 
for one of the images to be inserted. In this case, the empty 
insertion area may be left as it is. However, it is preferable 
for the blank insertion area to be filled with a preferable 
image prepared in advance. 

In the case where the images are inserted in the image 
insertion areas of the templates based on the location 
information, if a photographing opportunity of the image to 
be inserted in the image insertion area A7 of the template T2 



is missed for example , the image insert ion area A7 becomes blank . 
In this case, the image insertion area A7 may stay blank . However, 
the image insertion area All may become blank by shifting the 
images to be inserted in the image insertion areas A8 to All 
one by one. Alternatively, as in the second embodiment, one 
of the images photographed in a preferable condition may be 
inserted in the image insertion area A7 . 

In the above embodiments, if the recommended composition 
image RO is an image in a building such as a museum, the global 
positioning radio waves from the GPS satellites may not be 
received by the GPS means 3 of the camera. In such a case, 
the display means 8 cannot display the recommended composition 
image RO . Therefore, a selection menu of the recommended 
composition images RO, such as a menu shown in Figure 11, may 
be displayed on the display means 8 when the GPS means 3 does 
not detect the radio waves. For example, if the photographer 
enters the Louvre, his/her entrance can be detected by the GPS 
means 3. Therefore, a selection mode of the recommended 
composition images RO for the Louvre is displayed on the display 
means 8, as shown in Figure 11. Since the Louvre has three 
buildings, namely Richelieu , Denon, and Sully, pull - down menus 
for these are displayed. Denon is selected therefrom, for 
example, and "second floor" is further selected. A menu 
including Mona Lisa, Victory of Samothrace, 16th-century 
Italian paintings, and the like exhibited on the second floor 
of Denon is then displayed. When the photographer selects Mona 



Lisa, for example, the recommended composition image of Mona 
Lisa is displayed on the display means 8. Therefore, the 
photographer can photograph the image of the recommended 
composition even if the GPS means 3 cannot receive the global 
positioning radio waves. 

Furthermore, in the above embodiments, only the image 
data sets SO whose quantity agrees with the number of the image 
insertion areas of the templates are recorded in the recording 
medium 11 by the camera. However, a plurality of images may 
be photographed for any one of the recommended composition images . 
Moreover, the photographer may photograph images without using 
the recommended composition. In such a case, the images are 
displayed on the display means 8 of the camera, and the user 
selects a desired one of the images. Information indicating 
that the image is used for the album is added to the accompanying 
information H corresponding to the image data set representing 
the image. In this manner, the composition means 23 generates 
the composite image data M by using only the image data sets 
SO having this information in the accompanying information H. 

Moreover, in the above embodiments, the images are 
inserted in the image insertion areas of the templates in 
chronological order based on the information of the 
photographing time and date . However, thi s order can be changed 
arbitrarily. More specifically, the images are displayed on 
the display means 8 of the camera and information indicating 
the insertion order is included in the accompanying information 



H. The composition means 23 inserts the images in the image 
insertion areas of the templates based on the information 
indicating the insertion order. 

In the above embodiments, the template data sets T are 
stored in the template storing means 22, and the template data 
sets corresponding to the template information are read 
therefrom. However, the template data sets may be recorded 
in the recording medium 11 so that the data reading means 21 
can read the template data sets in addition to the image data 
sets SO and the accompanying information H. Alternatively, 
the template data sets may be recorded in a recording medium 
other than the recording medium 11 so that the data reading 
means 21 can read the template data sets from the recording 
medium. In this case, the template data sets may be stored 
in the personal computer of the user or provided from the 
laboratory to the user by being recorded in a recording medium 
or via a network. The template data sets may also be provided 
to the user by being recorded in the recommended composition 
storing means 4 . 

In the above embodiments, the template number is used 
as the template information. However, file names of the 
templates T can also be used. 

In the above embodiments, the album is generated by using 
the image data sets SO obtained by the camera shown in Figure 
2 for carrying out photographing according to the recommended 
composition based on the GPS information G . However, the image 



data sets used for album generation are not limited to the image 
data sets obtained by such a camera. For example, since image 
data obtained by a digital camera have information on the 
photographing time and date, this information can be used as 
the accompanying information H for inserting images in the 
templates as in the above embodiments. In this case, by adding 
information indicating future use for album generation to the 
image data to be inserted in the templates, the composition 
means 23 can read the accompanying information H and generate 
the composite image data M by using the image data sets SO having 
the information indicating the use. 

In the above embodiment, the templates are pre- selected 
and photographing is carried out according to the layout of 
the templates. However, the templates may be selected for the 
albumafter photographing is carried out based on the recommended 
composition. Hereinafter, this example will be explained as 
a third embodiment. 

Figure 12 is a block diagram showing a configuration of 
an image output system adopting an album generating apparatus 
as the third embodiment of the present invention. In the third 
embodiment, the same elements as in the first embodiment have 
the same reference numerals and detailed explanation thereof 
is omitted. In the third embodiment, the image output system 
comprises template selecting means 25 for selecting one of 
templates T to be used for generation of composite image data 
M from the templates stored in template storing means 22 based 
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on accompanying information H read by data reading means 21, 
and temporary template storing means 26 for temporarily storing 
the selected template T . Based on the accompanying information 
H, the template T is selected and the composite image data M 
5 are generated based on the selected template T. 

In the third embodiment, recommended composition data 
sets RO related to the accompanying information H having 
recommended time and weather for photographing and a recommended 
photographing condition are stored in recommended composition 
OlO storing means 4 of a digital camera. One of the recommended 

ffi composition data sets RO corresponding to a photographing 

location, photographing time and/or weather is read based not 
=|3 only on location information included in GPS information G but 

a also time information and weather information at the time of 

4=15 photographing, and image data SO are obtained by photographing 

=J5 according to the recommended composition data set. At this 

M= time, the accompanying information H includes a recommended 

composition ID for specifying the recommended composition data 
set RO used for photographing , the GPS information G , the weather 
20 information at the time of photographing , and the photographing 

condition. Each of the templates T is stored in the template 
storing means 22 in a state where the recommended composition 
ID for specifying a recommended composition image to be inserted 
in an image insertion area thereof is related to the template 
25 as accompanying information HO of the template. The 

accompanying information HO is added to tag information of the 
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corresponding template. 

The recommended composition ID represents a location at 
which photographing using the recommended composition data set 
is recommended and a recommended composition number at the 
5 location. For example, let a, b, c, ... represent a location 

x and let 1, 2, 3, ... represent a composition number i. The 
recommended composition ID for the recommended composition data 
set can be expressed as Fxi . If an identifier of each of the 
templates TisI, II, III, .... andif image insertion areas thereof 

10 are expressed as (1), (2), (3), each of the templates T is 

stored in the template storing means 22 with each of the image 
insertion areas thereof being related to the recommended 
composition ID to be inserted in the image insertion area, as 
shown in a table in Figure 13 . 

15 For example, information corresponding to a row of a 

template I in the table in Figure 13 is added to the template 
I as the accompanying information HO. More specifically, as 
shown in Figure 14 , the accompanying information HO is described 
in the tag information of the template I . According to the 

20 accompanying information HO, the template I has two image 

insertion areas (1) and (2) . The image insertion area (1) is 
related to a recommended composition ID (Fal) of a composition 
number 1 at a location a, or to a recommended composition ID 
(Fcl) of the composition number 1 at a location c. The image 

25 insertion area (2) is related to a recommended composition ID 

(Fbl) of the composition number 1 at a location b, or to a 
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recommended composition ID (Fdl) of the composition number 1 
at a location d. A recommended season and recommended weather 
are related to all seasons (all) and all types of weather (all) . 

Meanwhile, the accompanying information HO of a template 
VI is as shown in Figure 15. According to the accompanying 
information HO, the template VI has one image insertion area 
(1) . The image insertion area (1) is related to a recommended 
composition ID (Ffl) of the composition number 1 at a location 
f in rain or fine weather (w = r or s [weather = rain or sunny] ) 
in winter (s=w [ season = winter ] ) , or to a recommended composition 
ID (Fa3) of a composition number 3 at the location a in fine 
weather (w = s [weather = sunny]) in winter (s = w [season = 
winter] ) . 

In the third embodiment, a photographer recorded six image 
data sets SO in a recording medium 11 by photographing using 
the recommended composition 1 at locations a, b, c, d, e, and 
f. In this case, recommended composition IDs Fal, Fbl , Fcl, 
Fdl, Fel, and Ffl are added to the image data sets SO as the 
accompanying information H. The data reading means 21 reads 
the six image data sets SO and the accompanying information 
H added thereto, and the accompanying information H is input 
to the template selecting means 25. The template selecting 
means 25 reads two templates I and III from the template storing 
means 22 based on the accompanying information H, and inputs 
the templates to the temporary template storing means 26. At 
the time of generating the composite image data, the template 



I is used twice. Composition means 23 generates the composite 
image data M representing an album comprising three pages , based 
on the two templates I, the template III and six image data 
sets SO. 

In this case, images whose recommended composition numbers 
are 1 at the locations a and b are respectively inserted in 
the image insertion areas (1) and (2) of the template I, while 
images whose recommended composition numbers are 1 at the 
locations c and d are inserted in the image insertion areas 
(1) and (2) of the other template I. Images whose recommended 
composition numbers are 1 at the locations e and f are also 
inserted in the image insertion areas (1) and (2) of the template 
ill . 

Meanwhile, if the photographer records seven image data 
sets SO in the recording medium 11 by photographing at the 
locations a and b according to the recommended composition 1, 
at the location d according to recommended compositions 1, 2, 
and 3, and at a location g according to the recommended 
compositions 1 and 2. In this case, the template selecting 
means 25 reads three templates I, II, and III from the template 
storing means 22, and the templates are temporarily stored in 
the temporary template storing means 26 . The composition means 
23 generates the composite image data M representing the album 
having three pages, based on the three templates I, II, and 
III, and the seven image data sets SO. 

In this case, images whose recommended compos i tion number s 



are 1 at the locations a and b are respectively inserted in 
the image insertion areas (1) and (2) of the template I, while 
images whose recommended composition numbers are 2, 1, and 3 
at the location d are respectively inserted in the image insertion 
5 areas (1), (2), and (3) of the template II. Images whose 

recommended composition numbers are 2 and 1 at the location 
g are also inserted in the image insertion areas (1) and (2) 
of the template III. 

The template T may simply be selected based on the 
10 recommended composition ID. However, some combinations of 

templates are not preferable with regard to layout. In this 
case, it is preferable for the undesired combinations (or 
preferable combinations) to be stored in a memory (not shown) 
of the template selecting means 25 so that the undesired template 
15 combinations cannot be selected. 

In the above embodiment, photographing is carried out 
to cause the image to agree with the recommended composition 
based on the GPS information G. However, instead of the GPS 
information G, global position information judged by a PHS 
20 reception area may be used for the photographing. 

In the above embodiments, the image data sets SO and the 
accompanying information H are recorded in the recording medium 
11 and provided for album generation. However, the image data 
sets SO and the accompanying information H thereof may be stored 
25 in the personal computer of the user so that the image data 

sets SO and the accompanying information H can be read from 



39 



the personal computer of the user via a network connecting the 
data reading means 21 and the personal computer. 
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